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Abstract 

Let G be an afiine algebraic group acting on an affine variety X. We 
present an algorithm for computing generators of the invariant ring K[X] a 
in the case where G is reductive. Furthermore, we address the case where 
G is connected and unipotent, so the invariant ring need not be finitely 
generated. For this case, we develop an algorithm which computes K[X] G 
in terms of a so-called colon-operation. From this, generators of 7fLY] G 
can be obtained in finite time if it is finitely generated. Under the ad- 
ditional hypothesis that K [X] is factorial, we present an algorithm that 
finds a quasi-affine variety whose coordinate ring is K[X] G . Along the 
way, we develop some techniques for dealing with non-finitely generated 
algebras. In particular, we introduce the finite generation locus ideal. 



Introduction 

Throughout this article, G will be an affine algebraic group over an algebraically 
closed field K . By a G-variety we understand an affine variety X over K with 
a G-action given by a morphism GxI^I. The ring of regular functions on 
X is denoted by K[X]. G acts on K[X] by 

<j(f) = foa- 1 

for a G G and / G The invariant ring is 

K[Xf := {/ G K[X] | a(f) = f for all a G G}. 

Nagata [19] showed that K[X] G is finitely generated as a if -algebra if G is re- 
ductive, i.e., the trivial group is the only connected, unipotent, normal subgroup 
of G. On the other hand, Popov [21] showed that if G is not reductive, then 
there exists a G-variety X such that K[X] G is not finitely generated. Moreover, 
Nagata [20] showed that if X is normal, then K[X] G is always isomorphic to 
the coordinate ring K[U] of a quasi-affine variety U over K, even if if[X] G is 
not finitely generated. Several problems arise from these facts: 

"The research of the first author was supported by NSF grant DMS 0349019. 
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(1) Find an algorithm that constructs generators of K[X] G for G reductive. 

(2) Find an algorithm that decides whether K[X] G is finitely generated for G 
non-reductive. 

(3) Find an algorithm that constructs generators of Ar[V] G if it is finitely 
generated. 

(4) Find an algorithm that constructs a quasi- affine variety U with AT[V] G = 
K[U] (in the case that X is normal). 

In the case that K has characteristic 0, a solution for the first problem was 
given by the first author [1]. (More precisely, the article [1] deals with the case 
that G is linearly reductive.) The second author gave a solution of the first 
problem in the case that X = A n (K) is affine n-space and the action of G is 
linear [13]. The third problem was solved by van den Essen [4] for G = G a 
being the additive group and K being of characteristic (see Section 13.1.11 of 
this paper). Van den Essen's algorithm terminates after finitely many steps if 
and only if K [X ] Ga is finitely generated. 

In the first and last section of this paper, we do the following: 

• We give a complete solution to the first problem (Algorithm 1 1.7j) . An opti- 
mized algorithm is given for the case that X is normal and G is connected 
(Algorithm [TTTU| ). 

• We give a new algorithm for computing K [X] G in the case that G = 
G a is the additive group and X is irreducible (see Section 13. 1 .2[) . This 
algorithm works in arbitrary characteristic. As Van den Essen's algorithm, 
our algorithm first finds an / S A'[V] Ga \{0} and finitely many generators 
of the localization K[xfj a . This is used for computing generators of 
AT[V] Ga in a second step. If the invariant ring is not finitely generated, 
this second step continues to produce generating invariants forever. 

• We extend the algorithm for additive group invariants to the case where 
G is connected and unipotent, and X is irreducible (Algorithm 13. 8j) . The 
algorithm has the same nature as the one for the additive group. Thus we 
get a solution of the third problem for this case. 

• We find an algorithm for constructing a quasi-affine variety U with AT[V] G 
= K [U] in the case that G is connected and unipotent, and K [X] is facto- 
rial (Algorithm 13. 9|) . The isomorphism is given explicitly. This algorithm 
always terminates after finitely many steps. Thus we solve the fourth 
problem for this case. 

• We develop some ideas how the third problem can be attacked in general 
(Section GO}. 

We leave it to others to make any progress on the second problem. The middle 
section of this paper deals with non-finitely generated algebras. In the context 
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of this paper, this prepares the ground for the last section, but we believe that 
the following results from the middle section are of more general interest: 

• We introduce "colon-operations" (R : a)s and (R : a°°)s and give algo- 
rithms for computing them in the case that R C S are finitely generated 
algebras over a field and a is an ideal of R (see Section 12. 1| . The coordi- 
nate ring of an irreducible, quasi-affine variety appears as a special case 
(see Lemma T2.3p . 

• We prove that for a subalgebra R of a finitely generated domain over a 
field, there always exists / € R\ {0} such that Rf is finitely generated 
(Proposition 12. 8| . We also prove that the set of all these f's, together 
with 0, forms an ideal, the finite generation locus ideal. 

• We give a constructive version of Grothendieck's generic freeness lemma 



(see Theorem 12.141 and Algorithm 12. 15| . 



• We give an algorithm for computing the intersection of a finitely gener- 
ated domain over a field and the field of fractions of a subalgebra (Al- 
gorithm [2H7]) . This algorithm addresses the original version of Hilbert's 
fourteenth problem. Our algorithm terminates after finitely many steps if 
and only if the intersection is finitely generated. 

Acknowledgments. This work was initiated during a visit of the second au- 
thor to the University of Michigan. The second author thanks the first one 
for his hospitality. Both authors thank Tobias Kamke for carefully reading 
the manuscript and pointing out some errors to us. We also thank Frank 
Grosshans for sending us his nice paper [6] and thereby bringing a result of 
van der Kallen [10] to our attention. 

1 Invariants of reductive groups 

In this section we give algorithms for computing invariant rings of reductive 
groups acting on affine varieties. The assumption on reductivity of G is not 
needed in Section ITTTI 

1.1 Embedding into a linear space 

If X = A n (K) is affine n-space and the action is linear, we say that X is a 
G-module. We usually use letters like V or W for G-modules. A G-module is 
given by a morphism G — > GL n (K ) of algebraic groups. 

Our first goal is to embed an arbitrary G-variety X equivariantly into a 
G-module V. The idea for this is simple and standard. Since the G-action 
on K [X] is locally finite, there exists a finite-dimensional G-stable vector space 
W C K [X] which generates K[X] as a i^-algebra. So we obtain a G-equivariant 
cpimorphism from the symmetric algebra S(W) onto K[X]. Since S(W) = 
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K[W*], V — W* (the dual of W) is the desired G-module. However, for turning 
this rough idea into an algorithm, we have to work out quite a few details. 

Before we can even start to formulate algorithms, we need to specify the 
form of the input data. 

Convention 1.1. We assume that G and X are given by the following data: 

(a) generators of a radical ideal J C K[t%, . . . , t m ] in a polynomial ring such 
that J defines G as an afhne variety in K m ; 

(b) generators of a radical ideal / C K[xi, . . . , x n ] in another polynomial ring 
such that / defines X as an afhne variety in K n ; 

(c) polynomials gi, . . . , g n £ K[t±, . . . , t m , x±, . . . , x n ] such that for a point 
(£1, . . . , Cn) <= X and a group element a = (71, ... , 7 m ) £ G we have 

■ ■ = (9l(l,0, ■ ■ -,9n(l,i)) , 

where we write (7) for (71, ... , j m ) etc. 
We are now ready to formulate our first algorithm. 
Algorithm 1.2 (Embedding X into a G-module V). 

Input: An affine algebraic group G and a G- variety X given according to Con- 
vention 11.11 

Output: Polynomials cii.j £ K[ti, . . . ,t n ] £ {1, . . . , r}) such that 

(ax,i{i) ■■■ ai,r(7) N 



G — * GL r (K), (71,..., 7m) 



defines a G-module V — K r , and polynomials hi, . . . ,h r £ K[xi, . . . , x n ] 
such that 

x^y, (a,...,u^ {hi(i),...,h r a)) 

is G-equi variant and injective. 

(1) Compute Grobner bases Gi and Gj of / and J with respect to arbitrary 
monomial orderings on K[x±, . . . , x n ] and . . . , t rn \. 

(2) Substitute each g$ by its normal form NFg^ug, (^). (This means that 
whenever a monomial of gi is divisible by a leading monomial of an element 
of Gi or Gj, the corresponding reduction should be performed.) 

(3) Let G C K[xi, . . . ,x n ] be the set of all coefficients occurring in the <ft 
considered as polynomials in ti , . . . , t m . 

(4) Select a maximal if-linearly independent subset {hi, . . . , h r } C G. 
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(5) For i = 1, . . . , r, form 

hi := NF gjUg , (hi(gi, . . .,g n )) € K[ti, . . . ,t m ,xi, . . .,x n ]. 

(6) For i = 1, . . . , r, find a^i, . . . ,a^ r € ■ ■ ■ ,tm] such that 

r 

hi = J2 a hj h 3- (1-1) 

J=l 

This can be done by viewing as an equation in 

K{t\, . . . ,t m )[xi, . . . , x n ], comparing coefficients in the x- variables, and 
solving the resulting linear system with coefficients in K(t\, . . . ,t m ). In 
fact, there exists a unique solution, which lies in K[ti, . . . , t m ] r . 

Proof of correctness of Alaorithm \l.£[ We first remark that converting the gi 
into normal form (Step [2]) does not change their properties given in Conven- 
tion Unjc). We will assume that gi are in normal form. 

Throughout the proof let a = (71 , . . . , j m ) and r = (771, . . . , r] m ) be elements 
from G, and write or — (d, . . . , Cm) for their product. For (£1, . . . , £„) 6 X we 
have 

+ (&,...,£„) = (si + I) (ff(£i,...,£n)) = ffi(2,£), 

so 

o-- 1 (xi+I)=g i ( 1 ,x)+I. (1.2) 

We can write 

1 

gi /',,,./'., 

with /1, . . . , // € ■ ■ ■ , im] pairwise distinct monomials in normal form w.r.t. 

<7j and G K[x\, . . . , i n ] in normal form w.r.t. C?/. With this, (|I.2[) becomes 

E^(i)(^ + / ) = ' j_1 ^+ / )- ( L3 ) 

Let 

n I 

i=i j=i 

be the subspace of K[X) generated by the residue classes of all hij. With the hi 
selected as in StepSl a K-basis of W is given by hi +/,..., h r + 1. From (|I.3[) 
with (j being the identity element, we see that Xi + I E W for all i, so if [X] 
is generated by hi + J, . . . , h r + I as a if -algebra. This implies that the map 
X — > if r = V given by the /i, is injective. 
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Applying t 1 to (|1.3[) and then applying (|1.3[) with err in the place of a 
yields 

i i 

E fi(i) ■ r_1 ( /i « + J ) = r_1 K 1 ^ + J )) = E /i(c)(^,i + /) € w. 

3=1 i=i 

Since the /j are linearly independent as functions on G, this shows that all 
T _1 (/iij + J) lie in W, so is G-stable. To see that the Oij from Step [6] exist, 
choose a set i? C if [xi, . . . , x„] such that the h + I with h E B together with 
all hi + I form a if -basis of if [X]. Then for i € {1, . . . , n} we can write 

r s 
hi+I = E °<,3^3 + E ^.j^j' + ^ 

i=i i=i 

with /ij- € B and aij^a^j E if [ti, . . . , £ m ]. As /i^ is in reduced form w.r.t. Qj, 

the same holds for all djj and j. The definition of hi, Equation (|1.2p and the 
G-stability of W imply 

hi(ji,... ,y m ,xi, ... ,x n ) +1 = cr _1 (/i i + 1) e W, 



so 

E a ^ d)^ + E (iK- + 7 e w 

for all cr = (71, ... , j m ) E G. Since W is generated by the hi + 1, it follows that 
all a'i -(7) are zero, so a£ j € J. Since they are in normal form, <z^» =0 for all j, 

so hi + I — Y^j=i a i.jhj+I- Since all polynomials in this equation are in reduced 
form w.r.t. Qj, it follows that this is an equality in K[t\, . . . , t rn , x%, . . . , x n ]. So 
the di : j from Step [6] indeed exist. Their uniqueness follows from the fact that 
hi, . . . , h r are linearly independent over if, thus also over the rational function 
field if (h,..., t m ). 

Next we show that the a,i j define a G-module V — K r . Indeed, we have 



^2a itj (C)(h j +I) = (ar)- 1 (h i + I) = 
3=1 

(r \ r r 

fc=i / fc=i j=i 

so a-ijiC) = 12k=i a i,k{l)ak,j(v) by the linear independence of the hj + I. Fi- 
nally, the map <I>: X — > V given in Algorithm 11.21 is G-cqui variant, since for all 
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(fi, ■ • ■ ,£„) £ X we have 

/ a i,i(l) 
\ar,i(l) 

This completes the proof. 

1.2 Inseparable closure 

For R an algebra over a field if of characteristic p > and A C i? a subalgebra, 
we write 

VA:={geR\ <f> e A} 
and call this the p-th root of A in R. Moreover, 

A := {g € i? | <7 9 € A for some p-power g} 

is called the inseparable closure of ^4 in i?. -{/^A and A are clearly A-modules 
and if-algebras. The following remark sheds some light on the importance of 
the inseparable closure to invariant theory. 

Remark 1.3. Suppose that G is a reductive group over an algebraically closed 
field K of positive characteristic, and V is a G- module. Let A C K[V) G be & sep- 
arating subalgebra. By definition, this means that A has the same capabilities of 
separating G-orbits as if[U] G (see Derksen and Kemper [2, Definition 2.3.8]). 
Since the natural map V — > Spec max (if [V] G ) is surjective, this implies that 
the map Spec max (if[y] G ) — > Spec max (A) is injective. Assume further that A 
is generated by homogeneous invariants. Then Theorem 2.3.12 of [2] implies 
that -?T[V] G is integral over A. By van der Kallen [10, Sublemma A. 5.1] (for 
an expanded version of the proof see http://www.math.uu.nl/people/vdkallen/ 
errbmod.pdf), the integrality and the injectiveness of the corresponding mor- 
phism imply that -R"[V] G C A. Here the inseparable closure can and will be 

understood to be formed in Since if [K] G = K [V] G is always true, we 

conclude 

A = K[V] G . (1.4) 

(In fact, the converse is also true: If a subalgebra A C K [V] G satisfies (11.4[) . then 
it is separating.) The conclusion (|1.4[) is an improvement of [2, Theorem 2.3.12], 
which says that K [V] G is obtained from A by first taking the normalization 
and then the inseparable closure. This improvement only holds in positive 
characteristic. Using (|1.4p , we also get an improvement to the algorithm given by 
Kemper [13] for computing K [V] G . In fact, Algorithm 1.9 of [13] first calculates 
the normalization (Step 2) and then the inseparable closure (Step 3). Thus in 
positive characteristic, Step 2 can in fact be omitted. < 



a rAl)/ 
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In Kemper [13, Algorithm 4.2] an algorithm is given for computing tfA 
in the case that R is a polynomial ring. We need to modify this algorithm 
substantially to make it suitable for the case that R is any reduced finitely 
generated if-algebra. 

Algorithm 1.4 (p-th root of a subalgebra). 

Input: Polynomials h\,...,hi £ K[x\, . . . , x n ] over a perfect field K of charac- 
teristic p > such that I — (hi, . . . ,hi) is a radical ideal, and polynomials 
fi, . . . , f m £ K [xi, . . . , x n ] defining a subalgebra A := K[fi +/,..., f m + 
I]CR:=K[xi,...,x n ]/I. 

Output: Polynomials g\, . . . , g r £ K[x\, . . . , x n ] such that 

r 

(1) Let F be a free K[x\, . . . , a; n ]-module of rank (p rn + lp n + 1) with ba- 
sis vectors e ilt ... tim (i v £ {0,...,p- 1}), ^ (j £ {I,..., I}, i v £ 
{0,...,p- 1}), and e(°). 

(2) Form the if [xi, . . . , x„]-module M C F formed by all 

m 

eu,..., im + n/^ e(0) (ive{0,...,p-l}) 
i/=i 

and 

n 

e S...A. + II ^ V (0) 0' 6 {1, . . . , f}, i„ e {0, . . . ,p - l}). 

i/=i 

(3) Let K[yi, . . . , y n ] be a new polynomial ring and write if for the map 
K [yi, ... , y„] — + K[xi, . . . , x n ] sending each yi to x p . Also use the letter ip 
for the component-wise application of ip to the free module 
K[ yi ,...,y n }P m + l P m+1 . 

(4) Use Algorithm O below to compute Ci,...,C s £ K[y x , y n ] pm+lpm+1 
such that the p(C{) generate 

MnK[x p ,...,x p n } pm+lpm+1 

as a K[x p , . . . , a^J-module. 

(5) With vr: K [yi, y n ] pm+lpm+1 -> K[yx, y n f m the projection on the 
first p m coordinates, form 

s 

M:=Y, K[yx, y n ] ■ w{d) CK[ yi ,..., y n ] pm . 

i=l 

Moreover, form fx, ... , f m £ K[yi, . . . , y n ] from the fi by raising each 
coefficient of fi to its p-th power and substituting each xj by yj . 
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(6) Use Algorithm [TT5l to compute generators si , . . . , s r of Mf)K[fi, . . . , f m ] pm 
as a module over K[fi, . . . , f m ] and a matrix (aij) <E K[yi, ■ ■ ■ , y n } rxs such 
that 

(7) For i = 1, . . . , r, let <?j S K[xi, . . . , x„] be the (unique) p-th root of 

s 

i=i 

where C'j '' is the e^-component of Cj. 

Proof of correctness of Algorithm \1.4\ Throughout the proof we write g := g + 
I £ R for the residue class of a polynomial g E K[x\, . . . , x n ]. Take an element 

(m)= E "«,.., im e iI ,..., m +E e «2L*.«£..^.+« (0) « (0) 

ii,...,i m = j— 1 ii,...,i n = 1 

from (with all it's from K[x\, . . . , x n ]). Then (it) G M implies 

p— 1 m I p— 1 n 

E »• -II./;' -E E , •»• 

ii,...,i TO =Q v=l j=l ii,...,i n =l i/=l 

SO 

p— 1 m 

^= E 77 ^ — • \[^ (1-5) 

zi,...,j TT1 — i/— 1 

First we show that all g7 p lie in A All <p(Cj) lie in M, and therefore also 
Y^j=x ( P( a i,j) < P(^ ! j) e M - The e (0) -component of Y%=i v( a i,j)<P{Cj) is 9? by 
Step [7] of the algorithm. Moreover, for all ii,...,i m G {0, . . . , p — 1}, the 
ei 1 ,...,i m -component of Ylj=i a i,j^j 1S equal to the corresponding component 
of Si by Step [SJ and lies in K[f%, . . . , / m ]. Thus the e^,... ^-component of 
Y?j=i vfai.jMQ) lies in #M/i)> • • • ) ^(/m)]. But ^(/j) = /? by the definition 
of the fj , so from (|1.5p we obtain 

p— 1 m 

Si P = E ' II iT" 

ii,...,i m — i/— 1 

with iti 1 ,...,i m elements from K[ff, . . . , /pJ. Hence indeed gl p G A 

Now we show that every element from \/A is an Alinear combination of 
gi, . . . So take g € if [x i, ... , x n ] such that g € vA This means that 
j p eifl if [xl^, ■ ■ ■ ,x^ p }. So on the one hand there exists it ' € K\x\ , . . . , x*] 
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with If = ?zX ), and on the other hand we have Ui x » m G -^[/i> ■ ■ ■ > fm\ (f° r 
ii, . . • , i m G {0, . . . ,p — 1}) such that 

p—l m 

s°)=^= e ijr (i.6) 

il,...,im—0 u=\ 

Indeed, any element of A can be written like this. But this means that there 
exist polynomials v$ ^ G K[x\, . . . , x%\ (for j G {1, . . . , 1} and i\,...,i m G 
{0, . ..,p— 1}) such that 

p—l m / p—l n 

- (o) - E "< 1 1 / E E «E! -ll^- m 

i\ ,. . .,i m - i/— 1 j — 1 ix,...,i n =l i/=l 

Indeed, any element from / can be written as an expression as on the right hand 
side of (|1.7[) . Equation (|1.7[) implies that the element 

(a)= E <*w-«w-+E e «£...,< w «S....i.+« (0) « (0) 

of _F lies in Af. Observe that all coefficients of (u) lie in K[x\, . . . 1. Thus 
by Stepdjof the algorithm, (u) lies in the K[x\ : . . . , x^J-span of the <p(Ci). It is 
convenient to write Ui lt ,,, t i m = ¥'(^ii,...,im) with C^t!,...,^ G if[yi, ■ ■ ■ , J/ n ]- Then 

p-i _ 

E ' e iu-,i m e M 

with M as defined in Step [5J But we know that the tttj,.. i m really lie in 
if[/f, . . . , /£], which implies U iu ..., im G if [/i, . . . So by StepHJthere exist 

Bx, ■ ■ ■ , B r G if [/i, . . . , / m ] such that 

p— 1 r r S 

ti ,. . .,i m =0 i— 1 z— 1 j — 1 

Applying <p to this and setting hi := <p(Bi) £ K[ff, . . . , /£J yields 

p—l r s p—l 



E ^i,..., lm • e 21 ,..., lm = e^E^^j) ■ E ' 



ij ,...,i m =Q i= 1 j—1 i \ ,...,i m =0 

where (7j n, "* , * m ^ stands for the eii,...,t m -component of Cj, So for every ii, . . . , i m 
€ {0, . . . ,p — 1} we have 

Wti,...,t m = E^E^j) ■ ^(cj n '""' m) ). 
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Substituting this into (|1.6[) yields 

r s p— -1 m 

r = E^E^)- E ^(cf '•'•*' m) )-n^ 

4—1 j—1 i\ ,...,i m -0 z-*— 1 

But <p(Cj) G M for all j, so we can apply (|1.5p and obtain 



5 P = E ^ E ^) • vicf ] ) = E & ^ 

i— 1 J — 1 i—1 

where the last equality follows from Step [71 Since b t £ K[ff , . . . , /£J and since 
K is perfect, there exist p-th roots of the bi in K[fi, . . . , f m ]. Hence there exist 
bi £ A with 6f = bi. We obtain 



r = E^ p = E^ 



Since / is a radical ideal, this implies g = Y^i=i bi9i with bi £ A. This completes 
the proof. □ 



The following algorithm is used in Algorithm 11.41 It is a slight extension of 
Algorithm 7 in Kemper [11] (see also Kreuzer and Robbiano [14, Section 3.6, 
Exercise 10 c]). 

Algorithm 1.5 (Intersection of a submodule with a subalgebra). 

Input: Generators bi, . . . , bi of a submodule M C K[x\, . . . , x n ] r , and polyno- 
mials /i,...,/ TO £ K[xi,...,x n ] generating a subalgebra A := 
K[f u ...,f m ]. 

Output: - Generators c\,...,c a of M n A r as an A-module; 

- if desired, elements C\, . . . , C s £ K[y\, . . . , y m ] r with K[yi, . . . , y m ] 
a polynomial ring such that substituting g/j i— > /j in Ci yields Cf, 

- if desired, a matrix (a^j) € K[x±, . . . ,x n ] sxl such that 

i 

3=1 

for all i £ {1, . . . , s}. 

(1) Let 5* := K[x%, . . . , i„, j/i, . . . , y m ] be a polynomial ring with additional 
indeterminates y\, . . . , y m . Form the submodule M of S ,r generated by bi 
(i = l,...,l) and by (fj - y 3 ) ■ e k (J = 1, . . . , to, k = 1, . . . , r), where the 
efc are the free generators of S r . 
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(2) Choose a monomial ordering ">" on S r such that 

x i e j > Hi ' ' ' Dm e j' 

for all i e {1, . . . , n}, j,f 6 {1, ... , r}, and d k € N. 

(3) Compute a Grobner basis Q of M with respect to ">" . If the matrix (djj) 
is desired, keep track of how each element from Q can be represented as 
an S- linear combination of the hi and (fj — yj) ■ e^. 

(4) Let C\, . . . , C s be those elements from Q which lie in K[y±, ... , y m ] r , and 
obtain c, by substituting j/j > /j in Cj. 

(5) If the matrix (ojj) is desired, use the normal form algorithm to express 
each Ci as an S*- linear combination of the elements of G, and then as a 
linear combination of the bj and (fj — yj) ■ &k' 

l rn r 

Ci = Hi b i + ^ ~ % ) ' e fc ( 1 - 9 ) 

i=i i=i fc=i 

with ciij, 'ai,j,k € S 1 . Then ay is obtained by substituting i— > in a,ij. 

Proof of correctness of Alaorithm \1.5\ We only need to prove the correctness of 
step El since everything else is already contained in Algorithm^ 7 from 
Kemper [11]. First, the Cj are contained in M and therefore in M, so the 
normal form is zero. Hence the Sjj and aij,k in (|l-9p exist. Now substituting 
y u ^ /„ in Ijrgj) yields (JTSJ. □ 

Remark 1.6. Algorithm 11.51 can be generalized to arbitrary finitely generated 
commutative if-algebras. Suppose that A = K[x\, . . . , xi]/J is a subalgebra of 
a if -algebra B = K[xi, . . . ,x n ]/I with I < n (so In K[x\, . . . ,xi] — J), and M 
is a S-submodule of B r . Consider the quotient map 

if : K[x u . . . , x n ) r -» B r = . . . , i n ] r /F 

and define M = ip~ x {M). To compute M n A r , note that 

M nA r =Jlfn^%,...,s;i] r ) = 

yjfa-^M) n K[x u . . . , sif) = <p(M nK[x lt . . . ,xi] r ). 

Generators of M n isT[ari, . . . , xi] r can be computed using Algorithm 11.51 

We are now ready to present an algorithm for computing generating invari- 
ants of a reductive groups acting on an affine variety. Recall that every reductive 
group in characteristic is linearly reductive, so Derksen's algorithm [1] applies 
for computing its invariant rings. Therefore we may assume that the character- 
istic is positive. 
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Algorithm 1.7 (Invariants of a reductive group acting on an affine variety). 

Input: A reductive algebraic group G over an algebraically closed field K of 
characteristic p, and a G- variety X given according to Convcntion ll.il 

Output: Polynomials fx, . . . , fk £ K[%i, ■ ■ ■ , x n ] such that the residue classes 
fi + 1 £ K[X] are G-invariant and generate if[A] G . 

(1) Use Algorithm 11.21 to calculate an equivariant embedding X — > V into 
a G-module V. Let hi,...,h r £ K[xi, . . . , x n ] be the polynomials by 
which this embedding is given, and write K[V] = K [yx, . . . , y r ] with yi 
indeterminates . 

(2) Use Algorithm 1.9 of Kemper [13] to compute generators F\,.,.,Ff. £ 
K[yi, . . . , y r ] of iT[U] G . In fact, it is enough if Fx, . . . , Fk are homogeneous, 
separating invariants, as computed by Algorithm 2.9 of [13], in which case 
-ftT[U] G will be the inseparable closure of K\F\, . . . , Fk] (see Remark 1 1.3|) . 

(3) For i = 1, . . . , k, set 

fi := Fi(hx, ...,h r )e K[xi, . . .,X n ], 
and let A C K [X] be the K-algebra generated by the Ji := fi+I £ K[X]. 

(4) Use Algorithm ll.4l to compute %f~A C if [A]. Let S be the set of generators 
of -ffA returned by Algorithm 11.41 

(5) For each ~g £ S, test whether g £ A (see Remark ll.8[) . lig £ A, set 

fk+i := h, A := K[fi, . . . , fcfe+i] and k := k + 1. 

(6) If in Step O all ~g £ S were found to already lie in A, then K[X] G — A and 
we are done. Otherwise, go back to Step |4j 

Remark 1.8. The membership test in Step l5l of Algorithm 1 1 . 71 can be done as 
follows: With additional indeterminates t,t\, . ■ ■ ,tk choose a monomial ordering 
on K [t, ti, . . . , tk, X\, . . . , x n ] such that every monomial in t, t±, . . . , is smaller 
than any Xi, and every monomial in tx,...,tk is smaller than t. Compute a 
Grobner basis Q of the ideal in K[t, t\, . . . , tk, x\, . . . , x n ] generated by 

g-t, fi-ti (i = l,...,fc), and I 

with respect to this monomial ordering. Then g £ A if and only if Q contains 
a polynomial with the lead monomial t. This can be viewed as a (very) special 
case of Algorithm 1 1.51 

Proof of correctness of Algorithm \1.7\ With <p: X — > V the map given in Step[T] 
of the algorithm, we have a G-equivariant epimorphism 

tp*: K[V] -> K[X], F ^ F o <p 
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of if -algebras, and fi + 1, as formed in Step [31 is just the ip* -image of Fi. Thus 
A = K[fi+I, ...,fk + I], also formed in Step[3j is a subalgebra of K[X] G . The 
algorithm keeps increasing k and enlarging A until reaching the inseparable 
closure A. In this proof, the letter A will always denote the subalgebra formed 
in Step[3j 

Since K[X] is a reduced ring, clearly every g £ A is an invariant in K[X] G . 
Conversely, take ~g £ K[X] G . Since G is reductive, there exists a p-power s such 
that g s £ ip* (K[V] G ) (see Mumford et al. [17, Lemma A.1.2]), so g s = <p*{F) 
with F £ K[V) G . Since K[V] G is the inseparable closure of if [Fi, ...,F k ], there 
exists a p-power q with F q £ K[F\, . . . , Fk], so 

g sq eip* (K[F u ...,F k ])=A. 

This shows that indeed A = K[X] G . Since K[X] G is finitely generated as a 
if -algebra (see Nagata [19]) and if [X] G = A by the above, K[X] G is finitely 
generated as an ^4-module. This proves that Algorithm 11.71 terminates after 
finitely many steps. □ 

Problem 1.9. We are still left with the problem of finding an algorithm that 
computes A G , where A is a finitely generated K-algebra which need not be re- 
duced and G is a reductive group acting on A such that A is locally finite. By 
Nagata [19], A G is finitely generated in this case. 



1.3 Connected groups acting on normal varieties 

In this section we consider the case of a connected reductive group G acting on 
a normal, irreducible affine variety X . This case is more special than the one 
dealt with in Algorithm 11.71 But we will present a simpler and probably faster 
algorithm for computing K[X] G . The idea for this algorithm was stimulated by 
the paper [7] of Hashimoto, which gives an algorithm for computing generating 
invariants of a simply connected simple linear algebraic group with a linear 
action. 

Recall that for a reductive group G and a G-module V we can always com- 
pute a subalgebra A C if [V] G such that iffy] is integral over A. Indeed, the 
possibly simplest way of doing this is by computing what Kemper [13] calls the 
"Derksen ideal" by performing the first two steps of Algorithm 2.9 in [13] (same 
as the first three steps in Algorithm 4.1.9 from [2]), and then setting one set of 
variables equal to zero in the generators of the Derksen ideal (Step 4 in [2, Al- 
gorithm 4.1.9]). This will yield a set of polynomials {gi, . . . ,g s } C if [V] which 
define Hilbert's nullcone (see [2, Section 2.4.1 and Remark 4.1.4]). Now use Al- 
gorithm 2.7 from [13] to compute homogeneous invariants fi,...,fk £ K[V] G 
degree by degree until every lies in the radical of the ideal in if [V] gener- 
ated by the fj. Then K [V] will be integral over K[fi,...,fk]- An alternative 
method would be to use Algorithm 2.9 from [13] to compute a graded separat- 
ing subalgebra of K [V] G . Then K [V] G will be integral over this subalgebra (see 
Lemma 1.3 in [13]). Compared with the first method outlined above, computing 
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separating invariants involves one additional major Grobner basis computation, 
which is not really necessary for our purposes. 

We can now present an algorithm for computing A[A] G for X normal and 
G connected and reductive. The algorithm involves the computation of the 
integral closure of one ring in another, which will be discussed shortly. 

Algorithm 1.10 (Invariants for G connected and reductive, A normal). 

Input: A connected, reductive group G over an algebraically closed field A, 
and a normal, irreducible G- variety X, given according to Convention ll.il 

Output: Generators of K[X] G as a A-algebra. 

(1) Use Algorithm 11.21 to calculate an equivariant embedding <p: X — > V into 
a G-module V. 

(2) Construct invariants fi,. ■ ■ ,fk € A[U] G such that A[U] is integral over 
K[fx, . . . , fk] (see the above discussion). 

(3) Form the subalgebra A C K[X] G generated by all fcoip (see Step [3] of 
Algorithm HH}. 

(4) Use Algorithm l 1 . 1 21 to compute the integral closure B of A in if [A]. Then 

K[X] G = B. 

The following lemma will be used in the proof of correctness of 
Algorithm 11.101 We write G° for the connected component of an algebraic 
group G. 

Lemma 1.11. Let G be an affine algebraic group over an algebraically closed 
field K , and let X be a G-variety. Let A C K[X] G be a subalgebra such that 
K[X] G is integral over A. Then K[X] G is the integral closure of A in K[X]. 

Proof. We write B for the integral closure of A in AT [A]. First take b S B 
arbitrary. There exists a monic polynomial F S A[T] with F(b) = 0. Thus for 
every a £ G we also have F (a(b)) = 0. On the other hand, F has at most 
finitely many zeros in A [A]. Indeed, this follows from the fact that for each 
irreducible component Xi of A, restricting the coefficients of F yields a non-zero 
polynomial with only finitely many zeros in A[A^]. It follows that the G-orbit 
of b is finite. Therefore the stabilizer G& C G of b has finite index in G, which 
implies G° C G b . Hence b e A[A] G °. 
Conversely, take / € A[A] G °. Then 

F(T):= [] (T - a(f)) e K[Xf[T], 

creG/G° 



and F(f ) = 0. So / is integral over A[A] G and hence also over A. It follows 
that f e B. □ 
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Proof of correctness of Alqorithm M.KA It follows from the reductivity of G that 
X[AT] G is integral over A. From this, K[X] G = B follows by Lemma[TTTl □ 

The following algorithm for computing the integral closure of one ring in 
another is mostly drawn from Vasconcelos [22, Chapter 6]. 

Algorithm 1.12 (Integral closure). 

Input: A prime ideal / C K[x%, . . . , x n ] defining a normal domain B := 
K[xi, . . . , x n ]/I, and polynomials fx, . . . , fk G K[xx, ■ ■ ■ , x n ] defining a 
subalgebra A = K[fx, ■ ■ ■ , fk] Q B, where we write fi := fa + I. 

Output: Polynomials gx, ■ ■ ■ ,g r G K[xx, ■ ■ ■ ,x n ] such that K\gx, ■ ■ ■ ,g7] is the 
integral closure of A in B. 

(1) With an additional indeterminate t, form the algebra 

D := K[f\, . . . , A, t, txl, ■ ■ ■ , tx^} C B[t], 

(2) Compute h\, . . . ,h r G K[xx, ■ ■ ■ , x n > t] such that the hi £ B[t] generate 
the normalization D of D. This can be done by using de Jong's algorithm 
(see de Jong [9] or Derksen and Kemper [2, Section 1.6]). 

(3) For i = 1, . . . , r, obtain gi from by setting t = in hi. 

Proof of correctness of Algorithm \ 1 . IM Since B is a normal domain, the same 
is true for B[t] (see, for example, Eisenbud [3, Exercise 4.18]). Therefore D is 
contained in B[t], which shows that its generators hi do lie in B[t] rather than 
just in Q(B)[t], where Q(B) denotes the field of fractions of B. Consider the 
map <p: B[t] — > B of B-algebras given by t h- ► 0. The definition of D implies 
(fi(D) = A. For each h € D we have an equation 

h s + dxh 8 ^ 1 H h d r -ih + d s = 

with di G D. Applying ip to this yields an integral equation for ip(h) over A. If 
follows that the ~gi = ip(hi) from Step [3] are integral over A. 

Conversely, take g G B arbitrary such that b is integral over A. Then g, seen 
as an element of B[t], is integral over D. Moreover, Q(D) — Q(B[t]) by the 
definition of D, so g G Q(D). It follows that g G D, so there exists a polynomial 
F such that g = F [hi , . . . , h r ) . Applying ip yields 

.9 = <p(g) =F(gT,---,g7)- 

This completes the proof. □ 

Remark 1.13. In Algorithm 1 1 . 1 21 we have assumed that B is normal. We will 
sketch how to deal with the more general case where B is a domain which need 
not be normal. Compute the normalization B of B using De Jong's algorithm 
(see de Jong [9] or Derksen and Kemper [2, Section 1.6]). Let A be the integral 
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closure of A in B. Generators of A can be computed using Algorithm 1 1.1 21 Find 
^-module generators hi, . . . , h s of A. Define 

s 

M = {(a 1: ...,a s ) G B s \ ^o,-^ G B}. 

8=1 

Find g <E B\ {0} such that g/ij G S for all i. We may identify M with 

s 

{(ai, . . . , o a , 6) G B s+1 | ^ a^/ii + 6 = 0} = 

i=l 

s 

{(ai, . . . , o», 6) G S s+1 | ^ a iff /ii + 6g = 0}. 

i=l 

So M can be viewed as a syzygy module, and generators of M can be com- 
puted using Vasconcelos [22, §1.3] or Derksen and Kemper [2, §1.3] (computing 
syzygies between elements u± + I, . . . ,u± + / in B = K[xi, . . . , x n ]/I can easily 
be reduced to computing syzygies between u\, . . . , Ut and generators of I in the 
polynomial ring K [x\, . . . , x n \). We have 

s 

MnA s = {(ai, ...,a s )eA s \ ^a.h, G In B}, 

i=l 

Define <p : M B by (p(a 1: ...,a r ) = J2Ui a i h i- Tnen <^( M n A s ) = Af] B \s 
the integral closure of A in B. Generators of M n A s can be computed, using 
Remark 11.61 

2 Quasi-affine varieties and Hilbert's fourteenth 
problem 

This section provides some methods for dealing with non-finitely generated al- 
gebras. 

2.1 The colon operation 

For a subset B of a ring, B r will denote the set of all products of r elements 
from B. We generalize the notion of a colon ideal as follows. 

Definition 2.1. For a commutative ring S and subsets A, B C S we define 
(A : B) s = {.feS\fBCA} 

and 

oo 

(A : B°°) s =\J(A : B r ) s = {/ e S \ 3r fB r C A}. 

r=l 
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Example 2.2. If a and b are ideals of S, then (a : b)s and (a : b°°)s are the 
usual colon ideals (see for example Vasconcelos [22, Chapter 2]). 

If R is a domain with quotient field Q(R), and f E R\ {0} then 

(R:{f}°°)Q(R)=Rf, 

the localization of R with respect to the element /. This generalizes as follows. 
Suppose that R — K[X] is the coordinate ring of an irreducible affine variety 
X. Let Y C X be a the zero set of an ideal o C R. The ring of regular functions 
on the quasi- affine variety U := X \ Y is denoted by K [U]. 

Lemma 2.3. We have 

K[U] = (R:a°°) Q (R)- 

Proof. Suppose that f £ (R : a°°)Q(#) and p E U. There exists h E a with 
h{p) 7^ 0- We have g = h s f E R for some nonnegative integer s. So / = h~ s g is 
a regular function on an open neighborhood of p E U. Since p E U was chosen 
arbitrarily, we conclude that / E K[U]. 

Conversely, suppose that / E K[U]. We may write a = (a\, . . . ,a r ). Because 
K[U] C R a . there exists a nonnegative integer li such that a 1 * f E R for all i. 
Set TV = h + h H \-l r — r + 1. Then 

a^/ C i?, 

because is spanned by monomials a J 1 a\ 2 ■ ■ ■ a\ T with fci + • • • + k r = N and 
the definition of N implies that fcj > i, for some i. □ 

If / E a is nonzero, then we have K[U] C i?y and 

if[[/] = (i?:a oc ) Q(H) -(i?:a 00 ) % . (2.1) 

Note that such a ring of regular functions on a quasi-affine variety is not always 
finitely generated over K (see Nagata [20, Chapter V.5] or Winkelmann [23]). 
Rings of the form (R : a°°)Q( R - > are ideal transforms in the sense of Nagata [20]. 
Suppose that G is an algebraic group and X is an affine G-variety. Nagata 
showed that the invariant ring K [X] G may not be finitely generated [18]. How- 
ever, he also showed that if X is normal, then the invariant ring _ftT[JT] G is 
isomorphic to some ideal transform of a finitely generated domain over K [20, 
Chapter V, Proposition 4]. In other words, K[X] G can be viewed as K[U] for 
some quasi-affine variety U. Later, we will study this in more detail. 
The following lemma is easy to prove: 

Lemma 2.4. 

(a) If a is an ideal of the ring S, and B C S then (a : B)s and (o : B°°)s are 
ideals of S . 

(b) If S is an algebra over some field, AC. S is a subalgebra and B C A, then 
(A : B°°)s is a subalgebra of S . 
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Suppose that the additive group G a acts regularly on an irreducible affinc 
variety X. Then G a also acts on the coordinate ring S := -K"[-X"]- An algorithm 
for computing the generators of the invariant ring S Ga was given by van den 
Essen [4] . Van den Essen first constructs a subalgebra R of the invariant ring, 
and an element / e R such that S Ga — Rf n S — (R : f°°)s (for details, see 
Section I3.1.1[) . He then gives an algorithm for computing a set of generators 
of the ring S Ga = (R : f°°)s over K. The algorithm terminates if this ring is 
finitely generated. 

In this section we will give a generalization of Van den Essen's algorithm for 
computing generators of (R : f° a )s- We will give an algorithm for computing 
generators of the ring (R : a°°)s for a finitely generated domain S over K, 
a finitely generated subalgebra R and any ideal a of R. Our algorithm will 
terminate if and only if (R : a°°)s is finitely generated. This extension is quite 
useful, as it allows us to compute rings of regular functions on irreducible quasi- 
affine varieties by using ()2.ip . 

Suppose that S is a domain over a field K, R is a finitely generated subal- 
gebra and o C R is an ideal. Then (i? : a)s is an i?-module. Suppose that a is 
nonzero. Then we can choose a nonzero element / Go. From the definition it 
follows that f(R : a)s Q R- This way, we may identify (R : a)s as a submodule 
of R. In particular, (R : a)s is finitely generated as an i?-module. We will first 
give an algorithm for finding i?-module generators of (R : a)s- 

Convention 2.5. We assume that S — K[x\, . . . , x n ]/I where / is a prime 
ideal generated by a finite set Qi. 

Algorithm 2.6 (Computation of (R : a)s)- 

Input: Polynomials f±,...,f r £ K[x-y, . . . , x n ] such that R is generated by 
fi +/,..., f r + I, and a finite set A C K[y±, y2,...,y r ] such that the 
(nonzero) ideal a C R is generated by g(fi, . . . , f r ) + 1, g £ A. 

Output: A finite set Tt C K \x\, . . . , x n ] such that (R : a)s is generated by 
1 + I and all h + 1, h 6 Ti as an i?-module. Moreover, if (R : a)s = R 
then H = %. 

(1) Let b be the ideal in K[x\, . . . , x n , y\, . . . , y r ] generated by I and all yi — fi, 
i — 1, . . . , r. Compute a Grobner basis Qj of J := b n K[y%, . . . ,y r ]. 
(Choose an elimination ordering on the monomials of K[xi,...,x n , 
y±, . . . ,y r ] and compute a Grobner basis Qb of b. Then we have Qj — 
g b r\K[y x ,...,y r }.) 

(2) Choose u £ A such that u ^ J. (Reduce all elements u € A with respect 
to the Grobner basis Qj until we have found an element u that does not 
reduce to 0.) 

(3) Let d C K[yi, . . . ,y r ] be the ideal generated by J and A. Compute a 
Grobner basis Q c of the colon ideal c := ( J + (u)) : 5. 
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(4) Let D C K[x\, . . . , x n , 2/1, ... , y r ) be the ideal generated by /, u and all yi — 
fi, i = 1,2, ... ,r. Compute a Grobner basis Q u of u := n . . . , j/ r ]. 

(5) Compute a Grobner basis <? q of the intersection q := ufl c. 

(6) Compute a Grobner basis Gp of the ideal p := J + (u) in K[y\, . . . , y r ]. 

(7) Replace Gq by the subset of all elements that do not reduce to with 
respect to the Grobner basis Gp- 

(8) If Gq — {v\, . . . ,v s }, compute h%, ...,h s E K[x\, . . . ,x n ] such that 

Vi{h,...,f r )+I = u{h,...,f r )hi+I 

for all i. To find hi, . . . , h s , proceed as follows. Each Vi can be expressed 
in the form 

with a,i ig , hi, aj € K[xi, . . . , x n , yi, . . . ,y r ] for all g, i, j. (this can be done 
using the extended Grobner basis algorithm in step (4)). Then plug in 
Hi = fi for all i- We take 

hi hi \X\ , . . • 5 X n , f\, ... , fr ) 

for all i. Set Ti. = {hi, . . . , h s }. 

Proof of correctness of Alaorithm \2.6l Consider the ring homomorphism 

ip : K[yx, . . . ,y r ] -> K[x\, . . .,x n ]/I = S 

defined by j/j > fi + /. The image of ip is isomorphic to R, and the kernel of ip 
is J. So we have 

K[ yi ,...,y r ]/J = R. 

The ideal o C R is generated by all <p(g), g £ A. Since o C R is a nonzero ideal, 
there must exist a u 6 A such that ip{u) ^ 0. Hence there exists & u € A that 
does not reduce to modulo Qj. The colon ideal (tp(u)R : ci)r C R is equal to 
y(c), and (/? _1 ((9?(m)-R : o)ij) = c. The ideal u is equal to ip^^^S). We have 

q = ip- l {{ip{u)R : a)n n ip-^ip^S) = ip- l {{ip{u)R : a) R fl 

Also, we get 

p = = (it) + J. 

After step (7), q is generated as an ideal in R by Gq, u and J. It follows that 
(ip(u)R : <x)r n (p(u)S is generated by y(/i), h £ Gq and y(tt). 
Since 

y(tt)(i? : o) s = {tp(u)R : a) R n ^(u)S', 
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we have that (R : o)s is generated as an i?-module by 1 = (p(u)/ip(u) and all 

tp(v)/tp(u), V £ Qq. If Qq = {V\, ■ ■ ■ , V s } thcil 

lfi{Vi) = tp(u)(hi + I) 

for all i. Since Ti. — {hi, . . . , h s } we have that (R : o)s is generated by all 1 + / 
and all h + I, h £ Ti- 

By step (6) and (7) we have that <f(vi) £ <p(u)R, and hi + I £ R. Hence, if 
(R :a) s = R then H = <D. □ 

Algorithm 2.7 (Computation of (R : a°°)s). 

Input: Polynomials fi, . . . , f r € K[xi, . . . , x n ] such that i? is generated by 
fi + I, . . . , f r + I, and a finite set ^4 C if [j/i, t/2; • • • > 2/r] such that the 
(nonzero) ideal a C i? is generated by g(/i, . . . , / r ) + I, Q € A. 

Output: A (possibly infinite) sequence hi, h<z, h%, . . . of elements in 
K[xi, . . . , x n ] such that hi + I, h 2 + I, ■ ■ ■ generate (R : a°°)s as a K- 
algebra. If (R : a°°) is finitely generated, then the algorithm will terminate 
after finite time and the output will be a finite sequence. 

(1) F = 

(2) n = {h,...j r } 

(3) while H ^ do 

(4) output(W) 

(5) F := FUH. 

(6) Let H be the output of Algorithm 12.61 for the computation of (R : 0)5, 
where R is the algebra generated by all / + /, f E F and a is the ideal in 
R generated by all g(f 1 , . . . , f r ) + I, g e A. 

(7) enddo 

Proof of correctness of Algorithm \2. 'Tj Let Ri be the algebra R in step (6) in 
the i-th iteration of the while loop in lines (3)-(7). We have R\ — R and 

Ri+i 2 (Ri ■ aRi) s = (Ri : a) s . 

where a is the ideal in R generated by all g(fi, ■ ■ ■ , f r ) + I, g € A. It easily 
follows by induction that Ri+\ D (R : a l )s for all i. Note that in step (6), the 
algebra Ri is generated by all h + I with h £ F. Moreover, F is exactly the set 
of all polynomials that have been sent to the output. 
If the algorithm does not terminate, then we have 
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and 

oc oo 

(R:a°°) s = {J(R:a i ) s c{jR i . 

i=l i=l 

On the other hand it is easy to see (by induction) that Ri C {R : a°°)s for all 
i. It follows that 

(i?:a 00 ) s =U i? - ( 2 ' 2 ) 

If the output is hi, h%, . . . then the algebra generated by hi + I, hi + I, . . . 
contains Ri for all i. Therefore, the algebra generated by hi + I, /12 + 1, ■ ■ ■ is 
(R ■■ a°°) s . 

Suppose that (R : a oc )s is finitely generated. By (|2.2p , i?^ contains all 
generators of (i? : a°°)s for some i, and Ri = (R : a°°)s. But then TC = after 
the i-th iteration of the while loop and the algorithm terminates. The output 
is exactly F and Ri = (R : a°°)s is generated by all h + 1, h G F, □ 

2.2 Finite generation 

In this section we study domains which are not finitely generated over K. We 
introduce the finite generation locus ideal of such an algebra. 

Proposition 2.8. Suppose that S is a domain which is finitely generated over 
a field K and that R is a subalgebra of S. Then there exists an nonzero element 
f £ R such that Rf is finitely generated as a K -algebra. 

Proof. Choose a finitely generated subalgebra T C R such that T and R have 
the same quotient field. By the theorem of generic freeness (see Eisenbud [3, 
Theorem 14.4] or Remark 12.161 below), there exists a nonzero element / € T 
such that Sf is a free T/-module. Let B be a basis of Sf over Tf. We can write 

r 

1 = y^^Ujej 

i=l 

with ei, e<i, . . . , e r € B and Ui, 112, ■ ■ ■ , u r € Tf. Since Rf and Tf have the same 
quotient field, it follows that the submodule Rf C Sf is contained in 

T f ei ® T f e 2 ® ■ ■ ■ ® T f e r S TJ. 

This shows that Rf is contained in a finitely generated Tf -module. Since Tf is 
a finitely generated algebra, Rf is finitely generated as a T/-module. It follows 
that Rf is a finitely generated algebra. □ 

The following result is well-known. We give a proof for the reader's convenience. 

Proposition 2.9. Suppose that R is a domain over K and f,g G R\ {0} 

such that (/,<?) = R. If Rf and R g are finitely generated, then so is R, and 

R = R f PI Rg- 
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Proof. We may write Rf — K\a\, ■ ■ ■ , a r , f x ] and R g = K[b\, . . . ,bi,g l ] with 
cti, bj G R. We have 1 = xf + yg with x,y G R. Take zei?/fl i? g . Then 

z = = 4r with n, m £ N, a £ if[ai, . . . ,a r ,/], and b £ 2f[&i, . . . ,h,g], 
so 

z = z(xf + yg) m+n = 

Y,[ ){xf) l y m+n ^g m - l b+ J2 ( )x i f i - m (yg) m+,j 

i=l ^ 1 ' i=m+l \ * / 



Thus 

RC R f R g C K[di, ...,a r ,bi,.. . ,b h f, g,x,y] C i?, 
and the result follows. □ 

Proposition 2.10. For a domain R defined over a field K , define 

g = {0} U {/ G R\ {0} | Rf is a finitely generated K-algebra}. 
Then g is a radical ideal of R. 
Proof. If / G g and g E R are both nonzero, then 

%9 = ( R f)g 

is finitely generated, because Rf is finitely generated. This implies fg G g. 

Suppose /, g G fl such that /, g, and f + g are all non-zero. We have 
(f,g)Rf+g = Rf+g, and the algebras (Rf+ g )f = (Rf)f+ g and (Rf +g ) g = 
(Rg)f+ g are finitely generated. By Proposition 12.91 is finitely generated, 

so /+fl£fl- It follows that g is an ideal. 

The ideal g is clearly a radical ideal since Rfr = Rf for every / G R and 
any positive integer r. □ 

We will call g the /mif e generation locus ideal of i?. Note that g = R if and only 
if i? is finitely generated. If R is a subalgebra of a finitely generated algebra, 
then the finite generation locus ideal is nonzero by Proposition ^. 81 

Lemma 2.11. Suppose that S is a domain over K, R is a subalgebra, and 
a C R is an ideal. Set b — (R : (R : a)s)s- Then b is an ideal of R, and a C b. 
Moreover, 

(R : a% = (R : b l ) s 

for i G N U {oo}. 

Proof. Since o(i? : 0)5 C i? by definition of (R : a)s we get a C b :— (R : (R : 
a) s )s- Since 1 G (R : a) s we get b = (R : (R : a) s )s C (R : {1}) S = R. Also, b 
is clearly an i?-module, so it is an ideal of R. Since a C b we have 

(R:a) s 2 (R:b) s . 
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Because b = (R : (R: <x)s)s, we get b(R : <x)s C R. From this it follows that 

(R : o) s C (i2 : b) s - 

We conclude that 

(i? : o) s = (i2 : b) s - 
By induction on i we prove that 

(i? : a*) s = (i2 : b 4 ) s . 
The case i = 1 has already been done. Suppose that i > 1. Then we have 

(i2 : a l ) s = ((i? : a)s : a^s = ((R : b)s : - 

(i2 : bo'- 1 )^ = ((fl : O*- 1 ^ : b) s . 

By induction we may assume that (R : a z ~ 1 )s = {R ■ b z ~ 1 )s- So we get 

(R : a l )s - ((i? : a'" 1 )* : b) s = ((R : b^s : b)s = : b 4 )s- 

We also have 

(R : a°°) s - U(i? : a*) s = \J(R : b 4 ) s = (i2 : b°°) s 

□ 

Lemma 2.12. Suppose that R is a finitely generated subalgebra of a domain S 
over a field K, a is an ideal of R and suppose that R — (R : a°°)s = \JiRi, 
where 

RCR 1 CR 2 C... 
is a sequence of finitely generated K -algebras. Define the ideal Qi of Ri by 



Q t = \J (Ri : (Ri : o) s )s, 
where the radical ideal is taken in Ri. Then we have 

0i C q 2 C • • • 

:= [JSi 

i 

is the finite generation locus ideal of R. 

Proof. Let us define f)i — (Ri : (Ri : a)s)s so that Qi = Note that 

R=(R: a°°)s = (Ri : a°°) s = {Ri : f)°> - : 0°°)s (2.3) 
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by Lemma l2\lll Let ui,u 2 , ■ ■ ■ , u t be generators of the i?i + i-module (Ri+i : a)s. 
This module is contained in R = (Ri : Q°°)s- Therefore, there exists a positive 
integer I such that 

diUj C Ri 

for all j. It follows that 

9i(Ri+i '■ o)s C 

and 

q\ C : (fli+i : a)s) s = f) i+1 . 

Taking radicals on both sides gives us 

We now show that g = (J. is the finite generation locus ideal of R. If 
/ G g \ {0}, then f G Qi for some i. We have 

R=(R i :g?)sQ(R i )f, 
because f E Qi- It follows that 

R f = ( R i)f 

is finitely generated. 

Conversely, suppose that Rf is finitely generated for some / G R \ {0}. Say, 
Rf is generated over K by /ii, /12, . . . , h r G R and 1//. For some i, we have 
/, hi, h,2, ■ ■ ■ , h r G -R^. Therefore, we get 

RC(K[f,hi,...,h r }:f co ) s C(R i ) f 

Since (Ri : a)s is a finitely generated i?i-module, there exists a positive integer 
I such that 

/'(&•: a) s C 

We see that 

/' G [Ri : : a) S )s = hi- 
and f E Qi- □ 

Using Lemma 12. 121 it is now possible to find generators of the finite gener- 
ation locus ideal of the ring (R : a°°)s. To do this, we modify Algorithm 12.71 as 
follows. 

Algorithm 2.13. An algorithm for finding generators of the finite generation 
locus ideal of an algebra of the form (R : a°°)s where S — K[xi, . . . , x n ]/I is a 
finitely generated domain over a field K, R is a finitely generated subalgebra of 
S and a is an ideal of R. 
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Input: Polynomials fi, . . . , f r G K[xi, . . . ,x n ] such that R is generated by 
fi + I, . . . , f r + I, and a finite set A C K[yi, 1/2, . ■ . , y r ] such that the 
(nonzero) ideal a C R is generated by g(fi, . . . , f r ) + I, g £ A. 

Output: A (possible infinite) sequence hi, /12, /13, . . . of elements in 
K[x±, . . . , x n ] such that hi + J, h% + I , . . . generate the finite generation 
locus ideal g of (R : a°°)s. 

(1) F:=0 

(2) H : {./, /, ! 

(3) while ft ^ do 

(4) F := FUH. 

(5) output generators of g := \J ' (R : (R : d)s)s where R is the if-algebra 
generated by all / + /, / G F, and a is the ideal in R generated by all 

g(fi,...,f r ) + I, ge A. 

(6) Let TL be the output of Algorithm 12.61 for the computation of (R : a)s- 

(7) enddo 

The algorithm terminates if and only if (R : a°°)s is finitely generated. In that 
case g is the whole ring (R : a°°)s. So the interesting case is when the algorithm 
does not terminate. One should add a termination criterion in step (3), i.e., 
replace step (3) by 

while H ^ and not [TERMINATION CRITERION] do, 

where [termination criterion] is some criterion. For example, one could 
allow at most k iterations of the loop (3)-(7) where k is & parameter given in 
the input. Another example of a possible termination criterion will be given in 
Algorithm [27221 

To compute generators of g in step (5), one proceeds as follows. We compute 
generators of (R : a)s using Algorithm 12.61 Let 

t):=(R:(R: a) s )s 
Choose a nonzero element / Go. Since 1 G (R : o)s we have 

f, = (R : (R : a)s) S = (fR ■ f(R ■ o)s)«, 

so generators of f) can be computed because it is again a colon ideal. Finally, 
generators of g can be computed using an algorithm to compute the radical ideal 
of f) (see for example Derksen and Kemper [2, Section 1.5], Matsumoto [16], or 
Kemper [12]). The correctness of the algorithm follows from Lemma [2.121 
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2.3 Hilbert's fourteenth problem 

Suppose that if is a field, L is a subfield of the rational function field 
K(x\,X2, ■ ■ ■ ,x n ) containing K. Hilbcrt's 14 th problem asks whether in 
K[xi, . . . , x n ] is finitely generated. Nagata gave a counterexample to this con- 
jecture [18]. In fact, Nagata constructed an algebraic (non-reductive) group G 
and a linear action of G on the polynomial ring such that K[x\, . . . , x n ] G is not 
finitely generated. If we take L = K(x\, . . . ,x n ) G as the invariant field, then 
L n K[xi, . . . , x n ] — K[xi, . . . , x n ] G is not finitely generated, so this gives in- 
deed a counterexample to Hilbert's fourteenth problem. It is not clear whether 
it is decidable whether L n K[x±, . . . , x n ] is finitely generated, or even whether 

Ln%,...,i n ] =K. 

We will replace K[x±, . .., x n ) by an arbitrary finitely generated domain S 
over K. Let L be a subfield of the quotient field Q(S) of S. We assume that L is 
generated as a field by elements of the ring S. In other words, L is the quotient 
field of some subalgebra R C S. We will present an algorithm to compute 
generators of the algebra L n S = Q(R) n S. This algorithm will terminate 
if this algebra is finitely generated. First we need the following constructive 
version of "generic freeness" : 

Theorem 2.14. Suppose that S is a finitely generated domain over K , and R 
is a finitely generated subalgebra, then there exists an algorithm that finds a 
nonzero element f e R such that Sj is a free Rf -module, and Rf is a direct 
summand of Sf. 

See Eisenbud [3, Theorem 14.4] for a proof of a more general version of 
Grothcndicck's generic freeness lemma. Note that this lemma is often called 
"generic flatness" , but that almost all proofs found in the literature prove the 
stronger "generic freeness" property. We will give here an algorithm to find 
the / in question. For a slightly different algorithm, see Vasconcelos [22, The- 
orem 2.6.1]. We assume that K is a field for which we have algorithms for a 
zero test and all arithmetic operations. Assume that S — R[xi, . . . , x r ]/I where 
indetcrminates. 

Algorithm 2.15 (Generic Freeness). 
Input: R, S, generators of /. 

Output: An element / € R\ {0} such that Sf is a free i?/-module, and Rf is 
a direct summand in Sf. 

(1) Let J be the ideal in Q(R)[x\, . . . , x r ] generated by / (so it has the same 
set of generators as I). 

(2) Compute a Grobner basis Q of J with respect to some monomial ordering. 
If necessary, multiply the polynomials from Q by constants from Q(R) to 
make their leading coefficients equal to 1. 

(3) Compute / e R \ {0} such that fh(x\, . . . , x r ) e R[x\, . . . ,x r ] for every 
h(xi, . . . , x r ) e Q. 
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Proof of correctness of Alqorithm \2. /5l Let 

ip : R[x\, . . . ,x r ] — > S 

be the homomorphism with kernel / that induces an isomorphism 
R[xi, . . . ,x r ]/I = S. Let M be the set of all monomials m such that m is 
not divisible by any leading monomial lm(ft) with h G Q. We claim that Sf is 
a free i?/-module with basis <f{M). 

Suppose that h E Sf. There exists a positive integer I such that f l h 6 S. 
We can write f l h — u(xi, . . . , x r ) + I where u(xi, . . . , x r ) S -R[xi, . . . , x r ] C 
Q(R)[xi, . . . ,x r ]. Let v(xi, . . . ,x r ) be the normal form of u(x\, . . . ,x r ) with 
respect to the Grobner basis Q. Thus if 

Q = {hi(xt, . . .,x r ), . . . , h s (xx, . . . ,x r )}, 

then there exist a%(xi, . . . , x r ), . . . , a s (xi, . . . , x r ) S Q(i?)[xi, . . . , x r ] such that 

s 

u(xi, ...,x r )- v(x\, ...,x r )= }^aj(xi, . . .,x r )hi(xi, . . . ,x r ). 

i=l 

Note that hi(x%, . . . , x r ), . . . , h s (xx, . . . , x s ) € U/[a;i, . . . , x r ]. If p(xi, . . . , a; r ) € 
. . . , x r ] and q{xi, . . . , x r ) is obtained from p(x%, . . . , ar r ) by a single re- 
duction step modulo the Grobner basis G, then q(x\, . . . , x r ) G Rf[x±, . . . , x r ] 
as well. From this observation one can show using induction that 

ai(xi,. . . , X r ),. ■ • ,a s (xi, . . . ,x r ),w(xi, . . . , x r ) € Rf[xi, . . . , x r }. 

Now we get v{x\, . . . , x r ) e RjM, ip{v{x\, . . . , x r )) = f l h e Rf<p(M) and 
ft. G Rf<f(M). This shows that 5/ = Rfip(M), i.e., v?(M) generates Sf as 
an i?j module. It is clear from Grobner basis theory that f{M) is a linearly 
independent set over Q{R). We conclude that 5/ is a free i?/ module with 
basis (fi(M). We can identify Rf with Rftp(l) = Rf ■ 1 C 5/, which is a direct 
summand because 

<? / = J R / -ie%- ¥ >(M\{i}). 

□ 

Remark 2.16. Algorithm l2.15l is also correct in the case where R is not finitely 
generated. The only problem is that we cannot provide a way of computing the 
ideals I and J in this case. In fact, it in not even clear how to compute with 
elements from Q(R) if R is not finitely generated. Nevertheless, the above 
proof of correctness of the algorithm does provide a proof of the generic freeness 
theorem even for R not finitely generated. < 

Algorithm 2.17 (Intersection of a field and a finitely generated domain). 

Input: Generators and relations for a finitely generated domain S over K and 
generators of a finitely generated subalgebra R. 
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Output: Generators of the algebra Q(R) H S. The algorithm will terminate 
if Q(R) H S is finitely generated. If Q(R) n 5 is not finitely generated, 
then the algorithm will not terminate but the (infinite) output will still 
generate the algebra Q(R) n S. 

(1) Use Algorithm 12 . 1 51 to compute / e R \ {0} such that Rf is a summand 
in the i?/-module Sf. 

(2) Compute generators of (R : /°°)s using Algorithm 12.71 
Proof of correctness of Algorithm \2. 17\ We can write 

S f = Rf®C 

where C is an i?/-module. Let it : Sf — > Rf be the projection onto i?/. So 7r is 
an i?/-module homomorphism such that n(a) = a if and only if a € i?/. Suppose 
that s = a/b e 5/ with a, 6 e Then we have bs = a and &7r(s) = n(bs) = 
n(a) = a. So we obtain s = a/b = 7r(s) e i?/. This shows that Q(R)(lSf = Rf. 
It follows that 

Q{R) D S C Rf f] S — {R : f°°) s , 

so Q{R) C] S = (R : f°°)s because the other inclusion is trivial. □ 

The following theorem is Proposition 4 in Chapter V of Nagata [20] . 

Theorem 2.18. Suppose that R is a finitely generated normal domain over a 
field K , and L is a subfield of Q(R) containing K . Then RC\ L is isomorphic 
to the ring of regular functions on some quasi-affine variety U defined over K. 
In other words, there exists a finitely generated domain T over K and an ideal 
a of T such that 

i?ni = (T:0 Q(T) . 

Some extensions of this result can be found in Winkelmann [23]. Theo- 
rem [2T8] inspires us to ask the following questions. 

Problem 2.19. Let R and L be as in Theorem \ 2.18i Find an algorithm to 
construct generators of T and a where T and a are as in Theorem \2.18[ 

Problem 2.20. Suppose that S is a finitely generated normal domain over K , 
R is a finitely generated normal subalgebra and a is an ideal of R. Is the ring 
(R : a°°)s isomorphic to the ring of regular functions on some quasi-affine 
variety over K ? 

The following proposition gives a positive answer to Problem 12.201 under an 
additional hypothesis. We will later see that this hypothesis is satisfied in a 
situation which is of interest in invariant theory (see Algorithm 13 . 9[) . 

Proposition 2.21. Suppose that S,R,a are as in Problem \2.2(A Let q be the 

finite generation locus ideal of (R : a°°)s- Suppose that the affine variety corre- 
sponding to the ideal qS has codimension > 2, in other words, all prime ideals 
containing qS have height > 2. Then (i? : a°°)s is isomorphic to the coordinate 
ring of an quasi-affine variety. 
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Proof. The proposition follows from the correctness of the algorithm below. □ 

The following algorithm is a modification of Algorithm 12.131 

Algorithm 2.22. An algorithm for finding a subalgebra R C S and an ideal g 
of R such that 

(R: a °°) s = (R:Q°°) Qi n V 

where S is a finitely generated normal domain over K, R is a finitely generated 
subalgebra, and a is an ideal of R, such that the affine variety corresponding 
to gS has codimension at least 2, where g is the finite generation locus ideal of 
(R:a°°)s- 

Input: Polynomials fi,.-.,f r € K[xi, . . . , x n ] such that R is generated by /i + 
7, . . . , f r + 1 € K[xi, . . . , x n ]/I —: S, and a finite set ^4 C if [j/i, i/2j ■ ■ ■ , Dr] 
such that the (nonzero) ideal o C R is generated by g(fi, . . . , f r ) + I, 
geA. 

Output: Generators of a subalgebra R of R and generators of an ideal g of R 
such that 

(i?:a 00 ) s = (i?:g 00 ) Q(i j ) 

(1) Set F := and g := {0}. 

(2) H: {./, ./Vj. 

(3) while and [g5 has codimension < 2] and g5 7^ S do 

(4) F:=FUH. 

(5) compute generators of g := J {R : (R : a)s)s where R is the if-algebra 

generated by all / + I, f G F, and a is the ideal in R generated by all 
g(fi, . . . , f r ) + I, g G A. The radical ideal is meant to be formed in R. 

(6) Let H be the output of Algorithm 12.61 for the computation of (R : a)s- 

(7) enddo 

(8) output generators of R and g 

Remark. In step ([3]) of the algorithm, it is easy to determine the codimension 
of gS, since by Eisenbud [3, Corollary 13.4], the codimension equals dim(S) — 
dim (S/qS). The dimension can be read off a Grobner basis, see Greuel and 
Pfister [5, Corollary 7.5.5] or Derksen and Kemper [2, Section 1.2.5]. 

We also remark that the ideal g found by the algorithm is not necessarily 
the finite generation locus ideal. < 
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Proof of correctness vroof of Alaorithm UnZB . Let Ri and 0$ be the algebra R 
and the ideal in the z-th iteration of loop (3)-(7). We have 

Ri C R 2 C ■ ■ • 

and 

01 C 02 C • ■ ■ 

such that 0i is an ideal of Ri for all i. 

Assume that the algorithm does not terminate and the loop (3)-(7) is re- 
peated infinitely many times. Then (J. Ri = (R : a°°)s and g = |J. 0j is the 
finite generation locus ideal of (R : a°°)s, because of the correctness of Algo- 
rithm [2TT3] So we have 

01S c fl2 S c 03 S c ... . 

Since S 1 is finitely generated over K, it is Noetherian. There exists an index k 
such that 

9kS = Qk+iS = ■ ■ ■ = [J QiS = gS. 

i 

In particular, there exists an index k such that the affine variety corresponding 
to the ideal QkS has codimension > 2. Let k be minimal with this property. 
This implies that the algorithm terminates after the fc-th iteration of the loop 
(3)-(7), and the output is Rt and 0^. 

Let X be the affine variety such that S = K[X]. If / G (S : 0^°)q(5), 
then / is a rational function on X which is regular on all of X except for a 
closed subset of codimension > 2. Since X is normal, / is regular on X (see 
Eisenbud [3, below Corollary 11.4]), i.e., / G S. This shows that 

( s '■ 9T)q(s) = S. 

So we have 

(Rk ■ 0fe°)Q ( fi fc ) Q (S ■ qT)q(S) = S. 

It follows that 

( R k ■ 8 < k)Q(R k ) = ( R k ■ 9T)s = (R ■ a°°)s, 
where the last equality follows from (|2.3p . □ 

3 Invariant rings of algebraic groups 

Suppose that K is an algebraically closed field (of arbitrary characteristic) and 
G is an algebraic group over K which acts regularly on an affine variety X . If 
G is not reductive, then K[X] G may not be finitely generated. 

Problem 3.1. Find an algorithm which determines whether K[X] G is finitely 
generated. 
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Problem 3.2. Given that K[X] G is finitely generated, find an algorithm that 
computes a set of generators for K[X] . 

If G is reductive, then if[X] G is known to be finitely generated and an 
algorithm was given in Section[T] If G is the additive group and the characteristic 
of the ground field is 0, then an algorithm was given by van den Essen [4]. Here 
we will give such an algorithm in arbitrary characteristic and where G can be 
any connected unipotent group. 

Even if K [X] G is not finitely generated, there are still interesting questions 
to ask. Let K(X) G be the field of invariant rational functions on X. Then we 
have 

K[X] G = K[X] n K(X) G , 
If X is normal, then there exists a quasi- affine variety U over K such that 

K[X] G = K[U] 

by Theorem [HH 

Problem 3.3. Find an algorithm which constructs a quasi-affine variety U 
such that K[X] G = K[U]. 

We will give such an algorithm where G is a connected unipotent group and 
is a unique factorization domain. 

3.1 Invariants of the additive group 

Suppose that G = G a is the additive group acting regularly on an irreducible 
affine variety X over an algebraically closed field K. The coordinate ring K [G a ] 
can be identified with the polynomial ring K[t]. The group addition G a x 
G a — > G a corresponds to a ring homomorphism K[t] — > K[t] (g> K[t] defined by 
t h- >t(gil + l(g)t. The action G a x X — > X corresponds to a ring homomorphism 

fi : K[X] -> K[G a xX}= K[G a ] ® K[X] = K[X][t}. 

Suppose that / € ^[^]- We can write 

=f0 + fit + / 2 t 2 + • • • + frt r 

with fo, , . . , /,. £ K[X]. If a S G a , then we have 

((-a) • = /(a • x) - = /o(s) + h(x)o + ■■■ + f r (x)a r , 

so 

((-<?)■ f)=f0 + flO-+--- + frO- r . 

In particular we have 

/ = • / = f . (3.1) 
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We have 

(r - tr) ■ f = /o + h(<r - r) + ■ ■■ + f r (a - r) r = 

(r) • ((-a) ■ /) = (r ■ /„) + (r • h)a + • • • + (r ■ f r )a r (3.2) 

for all cr, r e G a = A. Comparing the coefficients of a r shows that r • /,. = f r 
for all r S G Q . This implies that / r € i^[X] Ga . We may extend \x to be defined 
for all / = g/h with g £ K[X] and h S A'[X] Ga by setting = ^{g)/h. 

Then still holds. 

If the action of G a is trivial, then of course A'fXp" = A"LY]. So let us assume 
that G a acts non-trivially. Then there exists an / 6 K[X) such that /j,(f) ^ f. 
This element / will be chosen once and fixed for the rest of Section l3Tl We can 
write 

F(t) := /*(/) = /o + /it + • • • + /r-i^ 1 + fX, t G G a , 
with r > and / r 7^ 0. 

3.1.1 Characteristic case. 

If K has characteristic 0, then an algorithm was given by Van den Essen 
for computing generators of K[X] Ga . This algorithm terminates if JsT[X] Ga 
is finitely generated. We will sketch the idea behind this algorithm. We 
set s = f r -x/(rf r ). From the coefficient of <r r ~ 1 in (|3 . 2[) . it follows that 
r • fr—i = fr-i — rf r T and r • s = s — r for all r € G a . 

Lemma 3.4. If he K[X] fr , then fj,(h) \ t =- s € K[X}^. 

Proof. Set 

H{t) := u.(h) =h + h 1 t-\ h hit 1 

with hi € K[X]f r . From IpOf it follows that 

ff(t- r) = h + -r) + • •• + hi(t - t) 1 = (r • ho) + (r • h{)t + ■ • • (r • 
Using this for t = — s + r gives us 

r • ff(-s) = ( T • h ) + (t ■ hi)(-r ■ s) + • • ■ + (r • hi){-T ■ s) 1 = 

= (T-h ) + (T-h 1 )(-S + T) + --- + {T-h l ){-S + T) 1 = H((-S + t)-t) = H(-S). 

□ 

Suppose that K[X] = K[h%, . . . , h m \. Define 

g* = KK) |t=-.e ^W/; 

for i = 1, 2, . . . , m. For every i, choose a natural number ki such that Uj := 
f^ 9i &K[X}. 
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Lemma 3.5. We have 

K[X]^=K[g 1 ,...,g m ,l/f r ] = K[u 1> ... > u m ,l/f r }. 

Proof. Define the ring homomorphism 7 : K[X]f r —> K[X] Ga by 7(3) = 
/J,(g) \t=-s- The homomorphism 7 is surjective, because 7(3) = |t = _ s = g 
for all g £ K[X] G «. Since K[X] fr is generated by hi, . . . , h m , l/f r , K[X]*}° is 
generated by j(hi) =gi,.. . ,f(h m ) = g m ,j(l/f r ) = l/fr- □ 

From Lemma l3~5l it follows that 

K[Xf« = (K[ui, . . . , u m , f r ] : (/ i .) 00 )k [ x ] 
Now generators of if[AT] Ga can be computed using Algorithm 12.71 

3.1.2 Arbitrary characteristic. 

Let us now no longer assume that K has characteristic 0. Van den Essen's 
algorithm may not work because r may be divisible by the characteristic of K 
for every possible choice of /, as the following example shows. 

Example 3. 6. Suppose that if is a field of characteristic 2 and define an action 
of the additive group on K[x,y] by 

H{x) = x + ty + t 2 ,fi(y) =y 

For every element / € K [x, y], is a polynomial of even degree in t. 

Let X be an irreducible affine variety on which Q a acts regularly and non- 
trivially. Choose again / S K[X] such that //(/) 7^ /. Again we can write 

F(t) := = fa + /it + • • • + M r 
with r > and f r 7^ 0. 

Lemma 3.7. If f r = 1, then K[X] Ga is finitely generated. 

Proof. Suppose an invariant g E K[X] Ga is mapped to zero by the canonical 
map 717: K[X] G * -> K[X]/(f). Then g = hf with h g so 

.9 = fi(g) - 

This implies g = 0, since otherwise the degrees of both sides of the above equa- 
tion would differ. It follows that ttj induces an inclusion K[X] Ga — > K[X]/(f). 

We claim that K[X]/(f) is integral over K[X] Ga . Suppose that u e K[X] 
and let U{t) = fi(u) e K[X][t}. Define P(s) £ K[X][s] as the resultant 

P(s)=Res t (U(t)-s,F(t)). 

Since F(t) is monic, it is clear from the definition of the resultant as the deter- 
minant of the Sylvester matrix (see Lang [15, IV, §8]) that cither P(s) or —P(s) 
is monic as well. 
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Consider the action of G a on if[X][i, s), where G a acts trivially on the 
variables t,s. If a € G a , then a ■ U(t) = U(t — a) by (|3.2[) , and similarly 
a ■ F(t) = F(t - a). Therefore 

a ■ P(s) = Res t (U(t -a)- s, F(t - a)) = Res t (U(t) - s, F(t)) = P(s) 

using Lang [15, Proposition 8.3]. It follows that all coefficients of P(s) lie in 
K[X] G *. 

There exist polynomials A(t, s), B(t, s) G ifLY][t, s] such that 

P(s) = A(t, s)(U(t) - s) + B(t, s)F(t) 

(see Lang [15, discussion before IV, Proposition 8.1]). If we substitute t = 
and s = u, we get 

P(u) = A{0,u)(U(0) - u) + B(0,u)F(0) = B(0,u)f, 

where the last equality follows from (|3.ip . Therefore P(u+(f)) = in K[X]/ (/), 
sou+ (/) is integral over K [X] Ga . The monic polynomial among P(x), —P(x) 
is the characteristic polynomial of u + (/) over K[X] Ga . Since u was arbitrary, 
K[X]/(f) is integral over K[X] G ". 

Suppose that hi, ... , h m are generators of -K^-X"]. Let R C K[X] Ga be the 
subalgebra generated by the coefficients of the characteristic polynomials of 
hi + {/) € K[X]/(f) over K[X] G * for i = 1, 2, . . . , m. We have R C K[X] G " C 
K[X)/(f) and R is clearly finitely generated. Since K[X]/(f) is finitely gener- 
ated and integral over R, we have that K[X]/(f) is a finite R module. Since 
K[X] Ga is a sub-i?-module of K[X]/{f), it is finitely generated as an i?-module 
as well. But then K[X] Ga is also finitely generated as an algebra. □ 

If f r = 1 and X is normal, then generators of ifLY] Ga can be computed as 
follows. By Lemma [l.lll i4T[X] Ga is the integral closure of R in if[X], where 
R is as in the proof of Lemma 13.71 This integral closure can be computed as 
described in Algorithm 11.121 If f r = 1 but X is not normal, Remark 11.131 may 
be applied to compute the integral closure. 

Let us now consider the general case where f r need not be 1 and X need 
not be normal (but is still assumed to be irreducible). Let s C K[X] be the 
vanishing ideal of the singular locus. This ideal is non-zero and stable under 
the action of G a . Without loss of generality, we could have chosen / S s such 
that /i(/) ^ f. We write 

F(t) = = fa + fit +--- + f r t r 

with f r 0. Choose distinct Ao,Ai,...,A r S K. Using that the Vander- 
monde matrix is invertible, we see that fa, fi, ■ • ■ , f r he in the if-linear span of 
F(Xo),F(Xi), . . . ,F(X r ). We have F(\ ), . . . ,F(\ r ) e s because s is G Q -stable. 
This implies that f r € s. So f r vanishes on the set of singularities, and K[X]f r 
is smooth. We have 



tif/fr) = (fo/fr) + (fl/fr)t +■■■ + {fr-l/ fr)t r - X + ? . 
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Using the previous discussion we can compute generators of K[X]^. Of course 
there is no need to choose / to lie in s if we apply Remark 1 1.1 31 to compute the 
integral closure. Suppose that 

K[X]f r =K[ 9l ,..., gi \ 

For every i we can compute a nonnegative integer hi such that u, := f^gi G 
K[X]. We then have 

K[Xf* = (K[ U1 , . . . , f r ] : UtDkixy 

Now generators of K[X] Ga can be computed using Algorithm 12.71 

3.2 Invariants of connected unipotent groups 

Suppose that X is an irreducible affine variety on which the additive group 
G a acts regularly. We have already seen that there exists an algorithm that 
computes generators for a subalgebra R C S := K[X] and generators of an 
ideal a such that S Ga — (R : a co )s- We now will deal with the more general 
case where a connected unipotent group N acts regularly on X. A unipotent 
group N is nilpotent (see Humphreys [8, Corollary 17.5]) and therefore solvable. 
If moreover N is connected, then by [8, Theorem 19.3] there exists a descending 
chain of normal subgroups 

N = Nk D N k -i D N k - 2 D '•• D Nq = (0). 

such that each quotient Ni/Ni-i has dimension one. By [8, Theorem 15.3(c)], 
each quotient is again unipotent, and therefore it is isomorphic to the additive 
group G a by [8, Theorem 20.5]. This allows us to give a recursive approach to 
the computation of generators of K[X] . The tricky part here is that K[X] Ni 
may not be finitely generated for some i, even if K[X] N is finitely generated. 

Algorithm 3.8. 

Input: The affine variety X (given by its coordinate ring S :— K[X]), the 
connected unipotent group N with its group structure (multiplication N x 
N — > N and inverse N — > N and the identity element e G N), the action 
N x X — > X, and a descending chain of normal subgroups 

N = Nk D N k -i D ■ ■ ■ D Ni D N a = (0) 

with explicit isomorphisms Ni/Ni—% = G a for i = 1, 2, . . . , k. 

Output: A subalgebra T C K[X] and an ideal OCT such that K[X] N = (T : 

(1) If N = (0) (and k = 0), then terminate with as output the algebra S and 
its ideal S. 
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(2) Find a finitely generated subalgebra R C S :— K[X] and an ideal a such 
that S Nl = (R : a°°) s as in Section O Say R = K[fi, . . . ,f r ] and 
a = (hi, . . .,h s ). 

(3) Let R' be the algebra generated by all u-fi where u € N and i = 1,2, ... ,r. 

(4) Let o' be the ideal of R' generated by all u ■ hj where u € N and j = 
1,2,. ..,s. 

(5) Invoke this algorithm with input R' and N' := N/Ni to find a subalgebra 
T C (R') N> and an ideal c of T such that (T : c°°) R , = (R') N ' . 

(6) Find a nonzero element a in (a')^ = a' n (R') N . Replace T by T[a] to 
ensure that a' (~1 T is not the zero ideal. 

(7) Output the algebra T and the ideal := c(a' n T). 

Before we prove the correctness of this algorithm, we explain some of the 
steps in more detail. 

In step (3), since Ni is normal in N, S Nl is stable under TV and R' C S Nl . 

In step (6): Note that N' is unipotent and a' is nonzero. We can find a 
nonzero finite dimensional subrepresentation W C a' because AT' acts regularly 
on the infinite dimensional vector space a'. But then W N is nonzero. This 
shows that (a') N is nonzero. A nonzero element in (a')^ can be found using 
linear algebra and exhaustive search. 

Proof of correctness of Alaorithm \3.8\ We need to show that 

S N = (T : D°°) s . 

We have 

S Nl = (R : a°°) s . 

We claim that we also have 

S N > = (R 1 : (a')°°)s. 

Suppose that / e S Nl . Since TV is a normal subgroup, S Nl is TV-stable. Let W 
be the vector space spanned by all u ■ f, u £ N. Then W is finite dimensional 
and contained in S Nl — (R : a°°)s- Then there exists a positive integer I such 
that 

a l W C R 

So in particular, 

for all u S N . Applying u gives 

(u ■ a)7 Cu-RCR'. 

Since a is finitely generated, there exists finitely many elements u\, . . . , u m such 
that a' is generated by • o, i = 1, 2, . . . , m. 
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Since 

(a')' m = (tti • a + u 2 ■ a + • • • + u m ■ a) lm C Ul • a' + • • • + u m ■ a 1 

we get 

(a') lm f C # 

and 

/ G (i?' : (aT)s- 

Conversely, if / G (i?' : (a')°°),s, then / is invariant under N\ because 
R' C S^ 1 and a' C S Nl is not equal to (0). 
Next we will show that 

S N = (T : c) 00 )^ 

where 

o = c(o'nT). 

Suppose that / e S N . Then / e S^ 1 = (R' : (o')°°)s, so there exists a 
positive integer / such that 

(a') l f C i?'. 

It follows that 

(a' n T) l f C = 
Since a' H T is finitely generated, there exists a positive integer m such that 

c m (o'nT)'/ C T. 

This shows that 0"/ C T for n > max{/,m} and therefore / e (T : O 00 )^. It 
follows that 

5 W C (T : 0°°)s. 

The reverse inclusion 

5 W D (T : 5°°) s 
follows because C S N and ^ (0). 

□ 

Finally we consider the case where TV is a connected unipotent group acting 
regularly on an irreducible factorial variety X. In this case we can effectively 
find a quasi-affine variety U such that if [X] G = K[U}. 

Algorithm 3.9. 

Input: The irreducible affine factorial variety X, a connected unipotent group 
N and a regular action N x X ^ X . 

Output: A finitely generated subalgebra R C K[X] and an ideal g C R such 
that 

K[X] N = (fl:fl°°W 
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(1) Find a finitely generated subalgebra R C K[X] and an ideal a of R such 
that 

- (R : a")^ 

using Algorithm 13.81 

(2) Apply Algorithm EHU to find R and <? such that (R : 9°°)q { r ) = K[X] N . 

Proof of correctness of Alqorithm \3.9\ We need to show that Algorithm ^ . 221 ap- 
plies here, i.e., we have to prove that the variety corresponding to 0-K"[Jl] is equal 
to K[X] or has codimension > 2. Suppose not. We can write y/gK[X] as the 
intersection of finitely many distinct prime ideals. One of these prime ideals has 
height 1, say p is such a prime ideal. Since N is connected, p must be stable 
under N. Since K[X] is factorial, p is a principal ideal, say p = (h). Since N is 
unipotent, it follows that h is invariant under N, so h £ K[X] N . 

We have already seen that K[X] N is isomorphic to the ring of regular func- 
tions on some quasi-affine variety U . There exists a finitely generated subalgebra 
S of K[X] N and an ideal b of S such that 

K[X} N = (S:b°°) Qis) . 

Clearly b C Q since K[X]J is finitely generated for all / € b. Therefore b C 
gK[X] C hK[X\. It follows that ft" 1 6 C K[X] and h^b C K[X] N . This 
shows that h- 1 e (S : b 00 ) QiS ) = K[X] N . But hr 1 K[X], so /i" 1 £ if [X]^. 
Contradiction. 

We have shown that the variety corresponding to qK[X] has codimension 
> 2. □ 



3.3 Invariants of arbitrary algebraic groups 

If G is an arbitrary algebraic group, then there exists a connected unipotent 
normal subgroup N such that G/N is reductive. Suppose that G acts on an 
irreducible affine variety X. One approach to compute generators of fT[X] G is 
by computing generators of ifLY]^ first. The problem of this is that if [AT]^ 
may not be finitely generated, even if K [X] G is finitely generated. If K[X] N 
is finitely generated, then Algorithm 13.81 can be used to compute a finitely 
generated subalgebra R of K [X] and an ideal a of R such that if[J>f] JV = (R : 
a °°)K[x] ■ Then Algorithm 1 2 . 71 can be used to find generators of K[X] N . Finally 
Algorithm 11.71 can be used to compute generators of ifLA] G = (K [X] N } G / N 
because G/N is reductive. 

Even if K [X] is not finitely generated, we might be able to compute gen- 
erators of K [X] G . Suppose that we have found R and a such that K [X] N = 
(R : a°°)K[x] using Algorithm 13.81 Assume that R = K[fi,...,f r ] and a = 
(ill, ... , h s ). We could try to copy the approach in Section I3~2"l So let R' be the 
algebra generated by a ■ fi with a G G and i = 1, 2, . . . , r and let a' be the ideal 
generated by all a ■ hj with a E G and j = 1, 2, . . . , s. Similarly as in the proof 
of Algorithm 13.81 we can show that 

K [Xf = (R> : (aTk[x] 
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If (a') G / N is not equal to the zero ideal, then one can show that 

K[X] G = {{R'f' N : {{a') G ' N )°°) K[x] . (3.3) 

Generators of (i?') G/JV can be computed using Algorithm 11.71 Generators of 
(a') G / N = a' n (R') G / N can be computed by using the usual Grobner basis 
techniques. Finally generators of K[X] G can be found using (|3.3|) and Algo- 
rithm [231 Of course this algorithm will not terminate, unless K[X] G is finitely 
generated. 

So what can we do if (a r ) G ^ N is zero? Perhaps the choice of R' and a' 
were unfortunate. Suppose that there exists an element / 6 K [X] G such that 
(K[X] N )f is finitely generated. Then / € fl where jj is the finite generation 
locus ideal of ALYJ^. Using Algorithm 12 . 1 31 we can construct subalgebras 

R x C R 2 C • • • 

and ideals 

01 C 02 C • ■ ■ 

such that {jRi = K[X] N and g = Ujfli. So we have / £ £k for some i. We 
terminate Algorithm 12.131 at step i when / £ . We have 

A[A] W = (R : a°°k[x] = : fj°°k[x]- 

So we might as well replace R by R = Ri and a by a = . We then still have 

K[X] N = (R : a°") K[x] 

but we also have / € a G ^ N , so a /^ is not the zero ideal. We can proceed to 
compute generators of the invariant ring if [A] G as discussed before. 

We just saw that there exists an algorithm to compute generators of Zf[A] G if 
there exists a nonzero element / £ AT[A] G such that K [X]^ is finitely generated. 
This may not always be the case as the following example shows. 

Example 3.10. Let H be the group and X be the representation in Nagata's 
counterexample to Hubert's fourteenth problem (see Nagata [18]). Here V is a 
32-dimcnsional representation and H is an algebraic group over the base field 
K = C and K [X] H is not finitely generated. Let N be the unipotent radical 
of H. Then A is a connected unipotent group, H/N is reductive, and K [X] 
is not finitely generated, because otherwise if[A] ff = (K[X] N ) H / N would be 
finitely generated. Let Q m — C* be the multiplicative group acting by scalar 
multiplication, and let G = Q m N . Then N is the unipotent radical of G. Since 
K[X] G = K, for every nonzero / e K[V] G we have K[X]f = K[X] N is not 
finitely generated. 

Suppose that G is an algebraic group and X is an irreducible normal G- 
variety. Suppose that the quotient field Q(K[X] G ) of the invariant ring K[X] G 
is equal to the field of invariant rational functions on A, denoted by K(X) G . 
First we can find the transcendence degree of K(X) G : K as follows. Let 



Computing Invariants of Algebraic Groups 



41 



n = dimX and let m be the dimension of a generic G-orbit in X. Then the 
transcendence degree of K(X) : K(X) G is m, and the transcendence degree of 
K(X) G : K is n — m. If we consider the morphism 

tP:GxX^XxX 

defined by 

t/>(ct, x) = (x, a ■ x) 

then the dimension of the closure of the image is n + m. Using Grobner basis 
techniques one can compute the dimension of the Zariski closure of the image 
of tj), and hence determine m. Using exhaustive search and linear algebra, one 
can compute a linear basis of invariants /i,/2, - " *= K[X] G . Terminate this 
exhaustive search if one finds among these invariants n — m algebraically inde- 
pendent functions. Let us call them hi, ... , h n - m . Let L be the field generated 
by hi, . . . , h n - m . Then K(X) G : L is an algebraic extension. Let R be the 
integral closure of K\h\, . . . , h n -m] m -^[^"]- Generators of R can be computed 
using Algorithm [Ull We have Q(R) = Q(K[X] G ). It follows that 

K[X] G = K{X) G n K[X] = Q(R) n K[X]. 

So we can use Algorithm 12 . 1 71 to find generators of if [A] G . 
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